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Abstract 

We propose an alternative method to compute the entropy production 
of a classical underdamped nonequilibrium system in a continuous phase 
space. This approach has the advantage that it is not necessary to distin- 
guish between even and odd-parity variables. We show that the method 
leads to the same local entropy production as in previous studies while the 
differential entropy production along a stochastic trajectory turns out to 
be different. This demonstrates that the differential entropy production 
in continuous phase space systems is not uniquely defined. 

1 Introduction 

In the past decade an important advance of nonequilibrium statistical physics 
has been the development of stochastic thermodynamics [TJ[2] . In this approach 
thermodynamic quantities such as the entropy are defined as functionals along 
the microscopic stochastic trajectory of the system in its configuration space, 
allowing one to study fluctuations around the average. This led to the discovery 
of various fluctuation theorems which generalize the second law of thermody- 
namics [3j|5j. For example, the total entropy Stot °f a system together with 
its environment in a nonequilibrium steady state is known to obey the integral 
fluctuation theorem (e~ AStat ) = 1, implying the second law (AStot) ^ 0. 

Discrete systems: The concept of stochastic thermodynamics is most easily 
introduced in the context of stochastic Markov jump processes. A Markov 
jump process is defined by a space of discrete classical configurations c € £1 
and certain transition rates iu c _> c <(i) > for spontaneous jumps from c to d . 
As time evolves, such a system jumps randomly in its own configuration space, 
producing a stochastic trajectory 

7 : c -> ci -> c 2 -> . . . (1) 
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of instantaneous transitions taking place at certain transition times t — t\,t2, 



In stochastic thermodynamics it is assumed that the total entropy can be 
written as a sum of the internal entropy of the system and the entropy of the 
environment 

StotW = S sys {t) + S cm {t). (2) 
The internal entropy S sys (t) is a fluctuating quantity defined by 

S sys (t) = - In p c ( t )(i) , (3) 

where p c (t) denotes the probability to find the system in the configuration c at 
time t. Since this probability evolves deterministically according to the master 
equation 

Mt) = (*)«>c-»c(t) ~ Pc{t)w c ^ d (t)] (4) 

e'en 

the internal entropy S sys (t) evolves smoothly superposed by discontinuous jumps 
whenever the system hops to a different configuration. Averaging S sys (t) over 
the probability distribution p c {t) one retrieves the usual Boltzmann-Gibbs or 
Shannon entropy 

(S sys (t)) =-Y / Pc{t)\n Pc (t). (5) 

c 

Nonequilibrium systems are usually driven from outside, i.e. they interact with 
the environment. On the level of the Markov process the environment is usually 
not modeled explicitly, rather it is implemented implicitly by means of asym- 
metric rates (w C '_>. c 7^ iu c _> c /). For example, a system describing the flow of 
heat between two reservoirs at different temperatures is usually described in 
terms of a biased diffusion process which drives the particles on average in one 
direction. In a nonequilibrium steady state the internal entropy (S sys (t)) of 
such a system will be on average constant, but the incessant external drive will 
continually increase the entropy in the environment. Remarkably, the external 
entropy production S env (t) can be quantified even if the physical properties of 
the environment are not known. In fact, as shown in [4j[9], whenever the system 
hops from c to c', S env changes discontinuously by the amount 

AS onv = ln^=^, (6) 

irrespective of the physical realization of the environment. 



Overdamped continuous systems: The entropy production for overdamped 
Langevin systems in a continuous state space is defined in same spirit. Let us, 
for example, consider the Langevin equation of a single particle 

x = fiF(x,t) + C(t) , (7) 
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where F(x, t) is a force, is a white Gaussian noise with temporal correlations 
(C(t)C(*')) = 2DS(t-t'), and /i = D/T is the mobility of the particle. Monitoring 
the particle coordinate up to time T, each stochastic path 7 = {x(t)} starting 
at position x a will occur with a certain probabilistic weight Pfylxo]. In this 
situation the entropy production in the environment is given by [5] 

where the symbol f denotes the operation of path reversal x^(t) = x(T — t), 
combined with the exchange of final and initial position x\ — xt and the re- 
versal of the protocol t —> T — t for time-dependent forces (corresponding to 
time-dependent rates in the discrete case). Obviously, this expression is just a 
continuum version of Eq. ([6]), where the positions x play the same role as the 
configurations c in the discrete case. 

It is important to note that the operation f does not involve a physical time 
reversal operation, i.e. there is nothing "running backward in time". In fact, 7^ 
is just the reflected path and [7^ \xq] its statistical weight in the same physical 
process running forward in time, only using a reflected protocol in the case of 
time-dependent transition rates. 



Underdamped continuous systems: In the underdamped case, however, 
the situation is more complicated. Here the state of a particle is characterized by 
positions q and momenta p. Considering (q, p) as a configuration and reversing 
a stochastic trajectory naively by replacing 

J = {q(t),p(t)} ll^ c = {qHt). / pHt)} = {q{T-t),p{T~t)} (9) 

would result into a conjugate trajectory running backward in space but with 
the velocity pointing in the wrong direction. This problem can be overcome 
by either an additional explicit reflection of time t — > —t, which means 7^ is 
actually running backward in time, or - formally equivalent - by redefining the 
f-operation in such a way that it changes the sign of p by itself. Using the 
latter approach Spinney and Ford (SF) introduced a general formalism that 
distinguishes between odd and even variables under the f-operation [6], i.e. 

l = {q(t),p(t)} — ► 7 f = {qHt) )P Ht)} = {eq(T-t) ) ep(T-t)} (10) 

with e = +1 for q and e = — 1 for odd quantities such as p. Using this formalism 
Spinney and Ford were able to compute the entropy production of arbitrary 
Langevin systems with inertia, in particular for underdamped equations of mo- 
tion in the full (q,p) phase space. 
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Fi gure 1; [Color online] Path reversal in phase space. Left: Reversing the trajectory naively 
by replacing t —> T — t leads to an unphysical path where momentum and velocity are oriented 
in opposite direction. Right: Path conjugation proposed by Spinney and Ford, flipping in 
addition the sign of the momentum. 



However, it remains unsatisfactory that the redefined f-operation maps the 
trajectory 7 to a completely different part of phase space, where the physical 
properties of the process could be potentially different (see Fig. [IJ. As for 
the terminal points of the trajectory, instead of simply exchanging xo with 
xt, one substitutes (qa,pa) — > {qr,— Pt) and (qt,Pt) — > ilo,~ Pa), the two 
terminal points are replaced with a different pair of points, which seems to be 
in contradiction with the spirit of Eq. We believe that this circumstance 
plays a role in the context of the so-called odd-parity variable problem which is 



currently discussed in the community 14 



In the present paper we demonstrate that the strict distinction between odd 
and even variables is not needed in order to define a physically meaningful en- 
tropy production. Following the spirit of Seiferts approach in Ref. [5] we define 
the differential entropy production by a logarithmic ratio of the weights of two 
forward processes, identifying the underlying Hamiltonian orbits as the micro- 
scopic states of the system. This approach is simpler as it is no longer necessary 
to distinguish between even and odd variables. Moreover, it is possible to con- 
sider Langevin equations with arbitrary functions which are neither symmetric 
nor antisymmetric. Surprisingly we find that the differential entropy production 
differs from the one computed by Spinney and Ford. However, evaluating physi- 
cal quantities both forms of the differential entropy yield exactly the same result, 
meaning that the two approaches are equivalent. Therefore, we arrive at the 
conclusion that the differential entropy production is to some extent ambigious, 
meaning that different expressions can describe the same physical situation. 



2 Definitions and Notations 

In what follows we study a particle with phase space coordinates (q(t),p(t)) in 
a potential V{q) which is in contact with an external heat bath. The stochastic 
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trajectory of the particle is described by the Langevin equation 

q=p, P = -V'(q)-j(p)p + r(p)Z. (11) 

Here denotes a white Gaussian noise with correlations = S(t — tf) 

which is understood to be integrated in the Ito sense throughout this paper. 
For simplicity we set the mass of the particle to m = 1. In order to include the 
possibility of nonlinear friction the coefficient j(p) and the noise amplitude T(p) 
are assumed to be p-dependent functions. In the simplest case of linear friction 
the coefficients 7 and T are constant and obey the Einstein relation T = \Z2T-f. 



Fokker Planck equation: Following Ref. ffl and using the vector notation 
x = (q,p) the Langevin equation ( 11 ) can be written as a stoachastic differential 
equation of the form 



dxi = Ai(x,t)dt + Bi(x,t)dWi 



(12) 



where dWi denotes the Wiener process generated by the noise £(t). For Ito 
integration, the probability distribution P(x, t) to find the particle in the phase 
space point x = (q,p) at time t evolves according to the Fokker Planck equation 



a t P(x,i) = -^a Xi J i (x,t) ! 



where 



J,(x, t) = Ai{x, t)P(x, t) - d Xi [A(x, t)P(x, t)] 
is the dynamical probability current with the diffusion coefficients 



(13) 
(14) 
(15) 



More specifically, for the Langevin equation (11) describing a single particle in 
a potential V(q) the Fokker-Planck equation (13) is given by 

d t P(q,p,t) = ([ 7 (p) +p 1 '{p) + Y{p)T"(p)+T'(pf] 



+ [p 1 {p)+2T(p)T'{p) + V'(q)]d p 

+ lr( P ) 2 d 2 p ~pd q )p(q,p,t). 



(16) 



Generalized Einstein relation: For a single particle in a heat bath the 
Langevin equations (11) can be split into a component given by the Hamilton 
equations of motion with the Hamiltonian H(q,p) = p 2 /2 + V(q) and a com- 
ponent ~"f{p)p + T(p)^ accounting for the heat bath. Of particular interest are 
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dynamical rules for which the system evolves into a stationary Boltzmann-Gibbs 
distribution of the form 



-W(q,p) 
Z 



= z exp 



(17) 



where ft = 1/T and ks '■= 1. Inserting this distribution on the r.h.s. of the 
Fokker-Planck equation one obtains a first-order differential equation in j(p) 
with the solution 



lip) 



1 



(3T(p) 2 - 



T{p)T'{p) , Ce^ 



P 



P 



(18) 



where C is an integration constant. Since the last term would lead to a divergent 
mean acceleration of the particle in the stationary state, it is unphysical so that 
we have to set C = 0. The remaining expression 



2 P1 {p) = f3pT(p) 2 - 2r(p)T'(p) 



(19) 



relates the noise amplitude T(p) with the friction coefficient j(p), generalizing 
the Einstein relation 2j = /3T 2 for linear dissipation and additive noise. 



Short-time propagator: An important function that will be needed to com- 
pute the differential entropy production in the following section is the short-time 
propagator G(x'|x;dt) of the Fokker-Planck equation. The short-time propaga- 
tor can be understood as the probability density to find a particle starting from 
position x at the position x' after an infinitesimal time span dt. 

Since the short-time propagator has to solve the Fokker Planck equation 



only to lowest order in dt it is not uniquely defined 10 11 . The origin of this 
ambiguity is two-fold. On the one hand, the form of the propagator function 
does not need to be Gaussian because the central limit theorem guarantees that 
any distribution with the correct first and second moment will lead to the same 
macroscopic propagator. On the other hand, there is an additional freedom in 
choosing the evaluation point of the amplitudes Aj(x, t) and £)^(x,t): These 
functions need not necessarily be evaluated at the starting position x of the 
propagator but they could also be evaluated at the final position x' or at any 
position in the immediate neighborhood of these points. Of course, this would 
generate corrections which have to be compensated to lowest order by suitable 
counterterms in the propagator. Although this freedom reminds one of the 
Ito-Stratonovich dilemma we emphasize that this ambiguity is an additional 
freedom which is completely independent of our choice to use the Ito scheme in 
the Langevin equation. 
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Following Ref. [8] we will consider a subspace of all possible solutions by 
introducing a parameter a € [0, 1] and defining the short-time propagator by 



G a (x'|x;dt) =[](4^Adt)- 1 



/2, 



(20) 



exp 



(dx l - Aidt + 2aD' l dt) 2 
AD~dt 

where the functions and their partial derivatives 



aA'At + a 2 D"dt 



Ai = Ai(r,t), A\ = d ri Ai(r, t) , 

A = A(r, t) , A = 9 n Di(v, t) , A" = c£ A(r, t) 

are evaluated at the point r = (1 — a)x + ax' on a straight line between the two 
points x and x'. It is straight forward to verify that this propagator solves the 
Fokker-Planck equation to first order in dt. 



Short-time propagator for an underdamped particle: The underdamped 



particle in Eq. (Ill is described by a system of two differential equations, namely, 



a deterministic equation q — p and a SDE for p. To compute the short-time 
propagator we first add an infinitesimally small noise in the first component, 
i.e. we consider the Langevin equations 



q=p + etq, P = ~V'(q) - "f(p)p + T(p)£ p 
with two uncorrelated Gaussian noise functions £ 9 (t) and £, p (t) 

1 



G £ a W,p'\q,p; dt) 



2ner{r)dt 



exp 



a 2 (r(r)r"(r)+r'(rf 



dt 



(21) 



(22) 



V'(q + adq)dt + 2aT(r)T' (r)dt + dp + r-f(r)dt 
2Y{r) 2 dt 

+ a ( n '(r) + 7 (r)) dt - ^'/^ 

where dg = q' — q, dp = p 1 — p, and 

T = r(p,p') =p + a(p' -p) 



(23) 
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is the momentum at which the functions are evaluated. As expected, by taking 
e — > we obtain 



n , i /i A .\ S(dq-rdt) 
G a (q ,P \q,p; dt) = —==—— exp 
V27T at 1 (r) 



a 2 (r(r)r"(r) + r'(r) 2 )dt (24) 
(V(adg + q)dt + 2aT(r)T'(r)dt + dp + rj(r)dt\ 2 



2T{r) 2 dt 

+ a (rj'(r) + j(r)) dt 
which is deterministic in the position coordinate. 

3 Differential entropy production 

The differential entropy dS cnv can be understood as a Taylor expansion of AS^m, 
to lowest order in dq, dp and dt along an infinitesimal line element of the tra- 
jectory 7 in phase space. In the following we show that this differential entropy 
production can be defined in different ways. 



Differential entropy production according to Spinney and Ford: As 

already outlined in the Introduction, the amount of entropy generated in the 
environment along a stochastic trajectory 7 is given by 

AS onv = In P[7|x °j , (25) 
Pt[ 7 t| x t] 

where f stands for a suitable path conjugation operation. As suggested by 
Spinney and Ford 6], this conjugation has to change the sign of odd-parity 
variables such as momenta, i.e. 

7 : (Qo,Po) (<7t,Pt) —> 7 f : (qt,-Pt) -> (<7o,-po) ■ (26) 

Using this definition of path reversal, the differential entropy production ac- 
cording to Spinney and Ford (see Eq. (25) of Ref. [§]) along an infinitesimal 
section of a path is given by 

d^^Wl, (27) 
G 6 (x't| x t;di) 

where a, b are free parameters reflecting the ambiguity of the short-time propa- 



gator. In the special case of the underdamped particle Eq. (21) we have 



dSZ - lim In g&jglMij^ . (28) 
° nV Gl(q,-p\q',-t/;dt) V ' 
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Clearly, the limit e — > can only be carried out if the two propagators peak at 
the same position in phase space. Roughly speaking this means that the two 



(5-functions (see Eq. ( 24 1 ) have to cancel out when taking the limit individually 
in the propagators since otherwise the entropy production would be locally 
divergent. This leads directly to the condition 

(q' -q)-(p + a{p' - p)) dt = - \(q - q') - (-p' + b(-p + p'))dt\ (29) 



with the solution b = 1 — a, replacing a lengthy derivation in the appendix of 
Ref. (8). Setting a = and 6=1 Spinney and Ford expanded the differential 
entropy production to first order in dt and to second order in dp, arriving at 

dsfJv - pa (~^ r2 _ r ' 3r " + r2r ' 2 _ r2 ^' + 2 7 r P r ' - 2 ip v ' - 2rr'y') dt 

^ (-2IT' - 2 7 p) dp + 0(dt 2 ) + 0(d P 3 ) , 

(30) 



r 2 



where for the sake of brevity we dropped the arguments of the functions T(p), j(p), 
and V(q) which are all evaluated at the point (q,p). 

Although all the final results derived by Spinney and Ford eventually turn 
out to be correct and physically plausible, the differential entropy production 
given above has surprisingly implausible properties. For example, for a free 
particle (V — 0) subjected to linear friction (jip) — 7 = const) in thermal 
equilibrium with a heat bath (r = ^J2T~f) the above expression reduces to 

dS e s n F v = -f3pdp- 1 dt. (31) 

This means that a resting particle (p = 0) continually produces negative entropy 
in the environment. This is surprising since in the discontinuous case a system 
resting in a particular configuration does not produce any entropy. In fact, this 
observation was the starting point that motivated the present work. 



On the meaning of points in phase space: In the arguments given above 
and in most papers about entropy production in continuous systems, it is im- 
plicitly assumed that the configurations c in the discrete case should correspond 
to individual points in phase space, i.e. the points in phase space are identified 
as the 'microstates' of the system. However, as we will argue in the following, 
it is not clear whether such a simple identification is correct. 

To see this, let us disconnect the external reservoir (in our example by setting 
j(p) = r(p) = 0). What is left over is a classical Hamiltonian system which does 
not produce entropy in the environment, analogous to a discrete system which 
stays in a single configuration c. However, the disconnected Hamiltonian system 
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Hamiltonian orbits 



Figure 2: [Color online] Two different schemes to define the conjugate path. Left: Spinney's 
and Ford's approach mirrors the terminal points at the q-axis into a different part of phase 
space. Right: In our approach the terminal points are instead exchanged along the underlying 
Hamiltonian orbits a and a' . 

does not stay in a single point, instead it still moves along its deterministic 
trajectory given by the Hamiltonian equations of motion. This leads us to 
the conjecture that all points connected by the Hamiltonian flow should be 
considered as belonging to the same 'microstate' of the system. In other words, 
we suggest that the 'microstates' of the system are the underlying Hamiltonian 
orbits rather than individual points in phase space. 

Reconnecting the system with the external reservoir, the thermal noise will 
permanently drive the system away from one Hamiltonian orbit to another. We 
suggest that such a thermally induced change of the Hamiltonian orbit can be 
interpreted as a spontaneous jump to a different 'microstate', analogous to a 
change of the configuration c — > c' in the discrete case. This would imply that 
only transitions between different Hamiltonian orbits should change the entropy 
in the environment, opposed to the formula ^ suggested by Spinney and Ford. 

Differential entropy production based on Hamiltonian orbits: In what 
follows we propose a new definition of environmental entropy production with 
respect to the Hamiltonian orbits instead of points in phase space. This defi- 
nition does not require parity operations, meaning that it is not necessary to 
distinguish between odd and even variables. As we will see, this leads in fact 
to a different expression for the differential entropy production. However, after 
integration we are led to exactly the same physical predictions as Spinney and 
Ford, suggesting that the definition of the differential entropy production is not 
unique. 

Our method is applicable to systems which can be separated into a Hamil- 
tonian part and another contribution coming from the external environment so 
that it is possible to identify the underlying Hamiltonian orbits, denoted here 
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by a. 

Our approach is motivated as follows: As shown in Fig.[2j a given stochastic 
path 7 typically connects two different underlying Hamiltonian orbits a and a'. 
According to the arguments given above, the conjugate path, which is denoted 
here by 7 (in order to distinguish it from 7^ used by Spinney and Ford) , should 
run from a' to a in such a way that the terminal points of the trajectories are 
crosswise connected by the Hamiltonian flow (see Fig. [2]). This ensures that 
both 7 and 7 are defined as forward trajectories in the same part of phase space 
so that the special treatment of odd variables is no longer necessary: 



path 


transition 


starting point 


ending point 


7 
1 


a -to 1 
a' -> a 


x = (q,p) 
x = {q,p) 


x' = (?',p') 
x' - (q',p') 



Using this conjugation scheme, we define the differential entropy production as 

where the phase space points x and x (and likewise x' and x') are connected by 
the Hamiltonian flow (HF) over the time span dt. The parameters a, b reflect the 
ambiguity of the short-time propagator and will be determined later. Moreover, 
we dropped a possible explicit time dependency of the propagator. 



Application to a single particle: In the example of a single underdamped 
particle, we have 



so that 



dS c 



lim In 



x= (q,p) = (q + pdt, p + f(q)dt) 
x'=(g',p') = (q'-p'dt, p'-f(q')dt) 

Gl{q',p'\q,p; dt) 



G% (q + pdt, p + f(q)dt I q> - p'dt, p> - f(q')dt ; dt) 



(33) 
(34) 



(35) 



Again this expression can only be evaluated if the singularities arising in the 
limit e — > cancel out, leading to the condition 

(q'-q)-(p + a(p'-pj)dt (36) 
= -\q- q') + (P + p')dt - (V - f(q')dt + b(p - p' + (/(g) + /(g'))dt))" 
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Expanding the force by /(<?') = f{q) + f'(q)(q' — q) + 0(dt 2 ) and neglecting 
terms of the order dt 3 this equation is solved for a = b = 1/2. This result is very 
plausible: It simply means that the functions appearing in the two propagators 
have to be evaluated at the same point in phase space. In the case considered 
by Spinney and Ford, apart from the reflection in the momenta, this means that 
the position coordinates have to coincide, giving a = b. In our method, however, 
this happens only at the particular point where the two trajectories cross each 
other, namely, roughly in the middle of the four points (x,x',x, x'). 

Inserting a = b = 1/2 the differential entropy production suggested by us is 
given by 

dSZ = ^ (-2P7V - 2IT V) dt + i (-2^7 - 2IT') dp (37) 

1 ( -H + - 7 - it" + r' 2 W + 0(dt 2 ) + 0(dt 3 ) , 



r 2 

where we again dropped the arguments of the functions T(p), r f(p), and V(q) 
which are all evaluated at the point (q,p). Obviously, this differential entropy 
production is different from the one in Eq. (|30|) proposed by Spinney and Ford: 



• In contrast to their result, our differential entropy production vanishes to 
first order in dt along the deterministic trajectory dp = —V'(q)dt. 

• While Spinney and Ford's expression is linear in dt and dp, our version 
includes also a second-order term dp 2 . 

• In our case the differential entropy production of a resting free particle 



vanishes while it is non-zero in the Spinney-Ford case (see Eq. (31)) 



4 Local entropy production rate 

Definition: The local entropy production rate 5 env is defined as the temporal 
derivative of the integral over the differential entropy production of all paths 
originating at the point x weighted with the corresponding probability of the 
path: 

+oo 

£ cnv (x) = lim i / dx' G c (x'|x; dt) dS cnv (x'|x; dt) , (38) 
dt— >o at J 

— oo 

where c € [0, 1] is another free parameter which reflects the ambiguity in the 
short-time propagator. Note that this parameter is independent of the param- 
eters o, b appearing in the differential entropy production and also independent 
of the integration scheme used in the Langevin equation. 
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In the example of a single particle we have 

+00 +00 



S cm (q,p) = I™ t: / <V / dp' G c {q',p'\q,p; dt) dS cnv (q' ,p'\q 7 p; dt) . 
dt^o dt J J 



-OO — OO 



(39) 

Since for dt — > the integral is dominated by short paths we can Taylor-expand 
the differential entropy production by 

00 

dS env (q\p'\q,p; dt) = £ a^p; dt) (q' - qftf-p)* . (40) 
»,i=o 



Inserting this expansion back into Eq. ( 39 ) we can rewrite the local entropy 
production as 

S C nv(q,p) = Hm -77 a ij(l'P' dt ) M tr,c(q,p;dt) , (41) 

i,j=0 

where My ;c denotes the moments 

+00 +00 

M^ c (q lP] dt) = [ dq' [ dp'G c {q',p'\ qi p-dt){q'~qy(p'~p)\ (42) 



-00 —00 



As we are interested in taking the limit dt —> in Eq. (41) it is sufficient to 
compute <Jij{q,p; dt) and Mij(q,p; dt) only to first order in dt. 



Calculation of the moments for an overdamped particle: Let us now 

compute the local entropy production rate for the overdamped particle 

Cl=P (43) 
p=-V , (q)- 1 ( P )p + T(p)at). 



We calculated the moments Mij- C (q,p;dt) in Eq. (J42j) by standard methods 
using a two-fold application of the saddle point method combined with a limit 
e — > 0, finding the following results: 

M 00 . c = l + O(dt) (44) 

M i ;c = (-JJ7(P) - V'(qj) dt + 0(dt 2 ) (45) 

M 02;c = T(p) 2 dt + 0(dt 2 ) (46) 

M ij;c = 0(dt i+1 ) (i,j>0) (47) 
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Remarkably, the parameter c in the short-time propagator in Eq. ( 42 ) does not 



appear in the relevant leading order terms but only in higher-order corrections. 



Now the local entropy production rate (41 1 can be calculated directly, and 



it turns out that both the approach by Spinney and Ford and our variant yield 
exactly the same result, namely, 

2p 2 1 {p) 2 



-lip) 



Tip) 2 

4p7(p)r / fr) 
r(p) 



piip) 

T'(p) 2 -T(p)T"{p) 



(48) 



In order to obtain the global entropy production rate averaged over the whole 
phase space as a function of time, this expression has to be integrated weighted 



by the actual probability distribution (see Eq. 16 ) 



Senv\t) 



dq 



dppiq,P,t)S env (q,p) . 



(49) 



Entropy production in thermal equilibrium: Let us finally consider the 
special case of thermal equilibrium. For a system where j(p) and T(p) obey 
the generalized Einstein equation (19 1, which is synonymous for transition rates 
obeying detailed balance, the differential entropy production according to Spin- 
ney and Ford and the present paper is given by 

dS c s n F v = -pp (dp + pV'(q)dt) - ^T{p) 2 dt (50) 
dSZ = -0p (dp + pV'(q)dt) . (51) 

As one can see, only the second version vanishes along the deterministic trajec- 
tory p = —V'(q). Nevertheless the local entropy production rate 

S CDV (q,p) = -\PV{P) 2 + \l3 2 p 2 T(p) 2 -(3pT(p)T , (p) (52) 

turns out to be the same in both cases. Note that this quantity may be nonzero 
even in equilibrium since the entropy production is a fluctuating quantity. How- 
ever, as expected the mean entropy production rate (491 integrated over phase 
space is in fact zero in the stationary state ( fl7| ), i.e. 

+oo +oo 

S% v = f dq J dp^e-^- v ^)s eQV ( q ,p) = 0. (53) 



This can be shown by splitting the last term in ( 52 ) into two equal halves and 
then rewriting one of them by parts. This is plausible since for equilibrium 
system, including those with generalized Einstein relations, the average entropy 
production rate in the environment should be zero. 
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5 Conclusion 



In this paper we have proposed a definition of the differential entropy pro- 
duction along a stochastic trajectory in continuous phase space systems with 
inertia. Our approach does not depend on the distinction between even and 
odd variables, instead it requires to split up the dynamics into an underlying 
deterministic and a stochastic part. The key idea is to consider a system that 
moves along its deterministic trajectory as remaining in the same state and 
that only jumps between different Hamiltonian orbits produce entropy in the 
environment. In other words, instead of points in phase space we identify the 
underlying Hamiltonian orbits as the microstates of the system. 

Following these physically motivated ideas we arrive at an expression for 
the differential entropy production dS^(q,p,dq,dp;dt) which differs from a 
previously studied expression proposed by Spinney and Ford. In particular, it 
vanishes along the underlying Hamiltonian orbits. 

The apparent contradiction can be resolved by computing the local entropy 
production rate S env (q,p) which turns out to be the same in both cases. This 
demonstrates that the notion of differential entropy production incorporates an 
element of ambiguity. As there are various short-time propagators generating 
the same time evolution, we arrive at the main conclusion that various versions 
of the differential entropy production generate, when integrated, the same local 
entropy production rate. A systematical investigation of the full range of this 
ambiguity would be desirable. 

Entropy production in thermal equilibrium: 

HH would like to thank U. Scifcrt and A. C. Barato for interesting discussions 
and helpful remarks. 

A Separating Hamiltonian and non-Hamiltonian 
parts 

The principle behind separating Hamiltonian and non-Hamiltonian parts of the 
dynamics is simple: upon time reversal, a Hamiltonian particle reaches its origin 
again. If it does not, then the discrepancy is precisely the non-Hamiltonian part 
of the equations. The most general case reads (with x = q or p). 

X = Mq,p)+r x (q,p)£ x (t) (54) 
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We are now interested in the non-Hamiltonian quantities q^, PA, so that equa- 
tions 

xh = x — ±a (55) 

form a Hamiltonian system. The procedure to obtain these quantities is straight- 
forward: 

1. Calculate x(t + dt/2). 

2. Reverse the system's dynamics by substituting p — > —p. 

3. Evolve the for another dt/2, starting at the previously reached end point, 
but with the new dynamics. 

4. The end position is x(t + dt), from which x& = x(t + dt) — x(t) can be 
determined. (±a is in the limit dt — > 0.) 

For example, this procedure applied to the underdamped particle discussed in 
the present work 

q = p 

p=-V'{q)- 1 {p)p + T(p)i{t) (56) 

results in 

q H =P QA = (57) 

PH = -V'(q) p A - - 7 (p)p + r(p)£(t) . (58) 

Note that this approach is quite general and can be applied to more complicated 
systems, in which the separation may not be as clear. 
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